HOLOMORPHIC HOROSPHERICAL TRANSFORM ON 
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Abstract. We develop integral geometry for non-compactly causal symmetric spaces. We 
define a complex horospherical transform and, for some cases, identify it with a Cauchy 
type integral. 



Introduction 

Within the class of semisimple symmetric spaces Y = G/H we focus on those which can 
be reahzed as Shilov boundaries of Stein tubes D = D(Y) in the affine complexification 
Yc = Gc/Hc- These Y come in two different flavors: compactly causal (CC) and non- 
compactly causal (NCC) symmetric spaces. It is important to mention that one can realize 
different series of representations of L'^{Y) as holomorphic functions on D: the holomorphic 
discrete series for CC and a multiplicity one subspace of the most continuous spectrum in 
the NCC-case. 

In pi] we developed integral geometry for D in the CC-case. If we consider the usual 
(real) horospherical transform on Y, then holomorphic discrete series lie in its kernel. So 
we considered a complex version of such a transform - horospherical Cauchy transform - 
using a kernel of Cauchy type with singularities on complex horospheres (on 1^) which 
do not intersect Y. As a result we constructed a dual domain in the manifold S of 
complex horospheres on Yc and our horospherical transform is an intertwining operator 
from holomorphic functions on D to holomorphic functions on S+ which admits an explicit 
inversion. 

In this paper we develop holomorphic integral geometry for NCC-spaces. In we 
constructed for any NCC-space a G-invariant tube type domain D{Y) in Yc which has 
Y as Shilov boundary. The crucial point is that D contains the associated Riemannian 
symmetric space X = G/K as a totally real submanifold. We have Xc — Yc- Let us remark 
that all spherical functions on X extend holomorphically to D and admit boundary values 
on Y. Furthermore, in some cases, D coincides with the maximal G-domain of holomorphy 
of spherical functions on X - the complex crown of X. 
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There are substantial differences in our constructions of liolomorpliic fiorosplierical trans- 
form for CC and NCC-spaces. In tlie CC-case we used a Cauchy type integral operator 
on Y with singularities on complex horospheres which do not intersect Y (horospherical 
Cauchy transform). For NCC-spaces we are able to construct similar operators in some 
cases, including the important subclass of Cayley type spaces. In general, we give another 
construction. We use the fact that complex horospheres which do not intersect Y allow real 
forms in D and we can construct a complex horospherical transformation extending the real 
one. Let us mention that this construction does not work in CC-case. If we have both type 
of constructions the second one can be regarded as a residue of first one. 

Let us decsribe our results in more detail. For a fixed choice of horospherical coordinates 
X ~ X A one parameterizes the set of real horospheres on X by G/MN (with M = 
Zk{A) as usual). For Schwartz-functions / on X one defines the real Radon transform 



Our first goal is to give a holomorphic version of 7^^. For that we construct a certain G- 
invariant sub manifold of the complex horospheres S = Gc/MqNc on Xc = Yq. The 
complex horospheres of S+ have the property that they do not intersect Y. Let us point 
out, that in contrast to the CC-case, is not longer open in H; it is a Ci?-submanifold of 
complex dimension equal to the rank of Y (i.e. dim A). Next we recall the most-continuous 
Hardy-space T-C^{D) on D from JT]. This is a Hilbert space of holomorphic functions on D 
with an equivariant isometric boundary map b : 1H?{D) L^^(y) into a multiplicity-one 
subspace of the most-continuous spectrum of Y . We show that there is a natural dense 
G-subspace 7{^{D)q of li?{D) whose elements restrict to Schwartz- functions on X and for 
which T^K allows a holomorphic G-equivariant extension 



We call TZ the holomorphic horospherical Radon transform. 

The main result of this paper is an interpretation of a (slightly twisted) Radon trans- 
form TZ^ as a Cauchy-type integral. For the highly symmetric subclass of Cayley-type 
spaces CT=CCnNCC we show in Theorem 5.3 that there is Cauchy-type kernel /C^(,) G 
Ci?~(H+)®5(F) such that 



Note that (jO.lj) is in analogy to our definition of the holomorphic horospherical Radon 
transform for the CC-case .13. . For the general case of an NCC-space we believe that there 
is an integral representation of TZ^ as in (lO.lj) but we are not aware of such. We consider 
the definition of a holomorphic horospherical Radon transform in terms of a Cauchy type 
integral to be most robust for further generalization to other symmetric spaces or different 
series of representations. 




(0.1) 
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For the CC-case, following |9., we found an inversion formula for the holomorphic horo- 
spherical transform of compelling beauty: 

Here £ is a differential operator and i-^ 0"^ is a dual transform |13j with regard to a double 
fibration which brings D and into duality. Let us remark that the situation is different for 
the NCC-spaces - for the basic example Y = Sl(2, M)/S0(1, 1) we show that £ is a pseudo 
differential but not a differential operator (cf. Section 6). 

The paper is concluded with a geometric definition of the most continuous Hardy space 
Ti}{D) which is of independent interest. 

Achknowledgement We thank the referee for his patient pressure on more precision. It is 
due to him that the paper is now more readable. 

1. HOROSPHERES ON SYMMETRIC SPACES OF TRIANGULAR TYPE 

In ^T] we associated to every NCC-symmetric space Y = G/ H a G-Stein manifold D with 
the following properties: 

(1) The complex manifold D has a natural G-realization in the complexification Yc of 

(2) The symmetric space Y = G/H is G-isomorphic to the distinguished (Shilov) bound- 
ary of D. 

The objective of this section is to study the space S = Gc/McNc of horospheres in Yq in 
relation to D. In particular we will introduce a natural G- invariant Gi?-manifold S+ C S 
whose elements have the properties that they do non intersect the real space Y, i.e. have no 
real points. 

1.1. Notation. We begin with the construction of NCC-symmetric spaces from the complex 
geometric point of view. 

Let us denote by g a simple non-compact real Lie algebra. We fix a Cartan involution 
^ • 0) write Q = t + p for the associated eigenspace decomposition and select a maximal 
abelian subspace a C p. Write H = {ai, . . . for a basis of the restricted root system 
S = a) and expand the highest root /? in terms of H 

f3 = kiai + . . . + knan {h e Z>o) . 

One calls ctj miniscule if fcj = 1. Let us recall that miniscule elements exist if and only if S is 
not of the type Es, -F4 or G2. For the remainder we fix a miniscule root a and define Z G a 
by the requirement ai{Z) = Sa^a- Observe that Z gives rise to a triangular decomposition 

(1-1) = 0-1+00+01 

with Qj = {X G I [Z,X] = jX}. Further the 3-grading ()1.1|) defines an involution a of g 
by cr(X) = {—lyx for X G Qj and eigenspace decomposition 

= 00 + (0-1+01) • 
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By construction a and 9 commute and hence t = ao6 defines an involution whose eigenspace 
decomposition shall be denoted = f) + q. The so-obtained symmetric pairs (g, 1)) we call 
non-compactly causal (NCC). It is an elementary exercise to classify all NCC-symmetric 
pairs. 

We denote by W the Weyl group of S, set Zh = f ^ and define Qh ^ ci by 

(1.2) riH = int{convex hull of W(Z//)} . 

Observe that Qh is a compact convex subset of a with extreme points }V{Zh)- 

On the global level we fix a linear connected Lie group G with Lie algebra q. We denote 
by Gc the corresponding linear connected complexification of G. Further we request that 
r as well is complex linear extension tq exponentiate to involutions on G, resp. Gq, and 
we denote by H, resp. He their corresponding fixed point groups. In this way we obtain a 
totally real embedding 

Y^Yc = Gc/Hc 

of Y in the Stein symmetric space Yq. We refer to F as a non-compactly causal symmetric 
space (NCC). 

Attached to Y and Qh comes a Stein manifold D which we will now describe. Write 
K < G for the compact group of ^-fixed elements and X = G/K for the corresponding 
Riemann symmetric space. As before we obtain a totally real embedding 

X Xc = Gc/ K(c ■ 
Recall that and are conjugate, i.e. with zh = exp^iZff) we have cf. [TT] : 

(1.3) e'^^'^^^hc = and Ad{zH)Kc = Hc. 
Hence Xq and Yq are canonically Gc-isomorphic via the map 

-^c 3 gKc ^ gzjlHc e Fc • 

In the sequel we identify Xc with Y^. 

We write Xo = Kc G Xc for the base point in Xc and set 

D = G exp^iQff) ■ Xo ■ 

Note that D was denoted by in our previous article ^j. According to [TTj, D is an open 
G-invariant Stein neighborhood of X in Xc = Ic. Moreover, the map Y = G/H 3 gH i— 
gzH ■ Xo G Xc identifies Y with the distinguished boundary ddD of D (see jTTj, Section 1, 
for more details). 

In summary, the symmetric Stein manifold Xc = Yq admits 2 real forms X and Y and a 
Stein neighborhood D oi X with Y as its Shilov boundary. 
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1.2. Complex horospheres. From now we let Y = G/H be an NCC symmetric space and 
X = G/K its Riemannian counterpart. 

In this section we introduce the G-space of horospheres in the complex manifold Xq = Yq. 
This was done for CC-spaces in jT^. 

We begin with some general remarks on convexity which we will use frequently. Let 
G = NAK be an Iwasawa decomposition of G and A^c^c-^c S its Zariski-open com- 
plexification. In particular, NcAic-Xo is a Zariski-open subset in the afiine variety Xc. Define 
the finite 2-group F = Aq fl Kq and note that there are well defined holomorphic maps 

n : NcAc ■ Xo ^ Nc, a: NcAc ■ Xo Ac/ F 

such that z = n{z)a{z) ■ Xo for all z G N^Aq ■ Xo- Now, the fact that D is contractible and 
D C NqAq ■ Xo, implies that a\£) admits a well defined holomorphic logarithm 

log a : D ac . 

For Z G Qh, the complex convexity theorem (cf. piU ITH]) then implies that 

(1.4) Imloga(G'exp(iZ) ■ Xo) = conv(W ■ Z) 

where conv(-) denotes the convex hull of (■). 
Submanifolds of Xc of the type 

gNc -Xo (g e Gc) 

will be referred as horospheres. We denote by Hor(Xc) the set of all horospheres on Xc and 
note that Hor(Xc) has a natural G-structure {g, HN^ ■ Xo) ^ ghNc ■ Xo- 

To understand the space horospheres and the related harmonic analysis it is useful to 
bring them in the context of a double fibration. Set M = Zx{A) C Mq = Z^f-i^), define 

S = Gc/McNc 

and consider: 

(1.5) Gc/Mc 




Then horospheres in Xc are exactly the subsets of Xc of the form 

(1-6) E{0 = 7.2{n^\0) (ees). 

If = MtcNc G H denotes the base point and ^ = (? ■ ^ S then, using that Mc C He, we 
have: 

E{() = gMcNc ■ Xo = gNc ■ C Xc . 
Similarly, for z G Xc we set 

(l.T) S{z) = n,{n,\z)) . 
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If z = g ■ Xo ioi g E Gc, then S{z) = gKc ■ ^q. Moreover, for z G Xtc and ^ G S one has the 
incidence relations 

(1.8) z G E{0 ^ n ir,\z) ^ ^ ^ G S{z) . 
Proposition 1.1. The map 

S^Hor(Xc), ^^E{0 

is a G<c-equivariant bijection. 

Proof. Gc-equivariance and surjectivity are clear. The injectivity follows the same way as 
in the proof of Proposition 2.1 in [T^ by replacing Hq by Kq. □ 

One of the important features of S is, that there exists a right Ac-action on S that 
commutes with the left Gc-action. For ^ = g ■ C,o and a G Ac we set 

(1.9) ^.a = ga-^o- 

Since Ac normalizes McNc it is clear that ()1.9|1 is well defined. From the definition it is also 
clear that the left Gc-action and the right Ac-action commutes. In this way we obtain an 
action of Gc x Aq on S by 

(GcxAc)xS^S, {{g,a),^) ^ g ■ ^ ■ a. 

We conclude this subsection with an alternative characterization of horospheres as level 
sets of holomorphic functions. For that let {ui, . . . ,u!n} C a* be the set of fundamental 
i^-spherical lowest weights. For each 1 < j < n we write (vTj, Vj) for the corresponding finite 
dimensional representation of G with lowest weight uj. We extend this representation to a 
holomorphic representation of Gc which we denote by the same symbol. Endow Vj with a 
complex bilinear pairing ( , ) such that {iij{g)v,w) = {v,7Tj{9{g)~^)w) for all v,w eVj and 
g G Gc- Such a form ( , ) exists as vr o 6* is isomorphic to the representation contragredient 
to 7Tj. We write vj G Vj for a lowest weight vector and rij G Vj for a Kc-fixed vector subject 
to the normalization {r]j,Vj) = 1. Finally, define holomorphic functions on fj : Gc ^ C by 

(1-10) f,{g) = {7r,{g)r^„Vj) (g E Gc) . 

Note, that we have 

(1.11) fj{nak) = a'^i 

for all n G Nc, k G Kc and a G Ac- Here, as elsewhere in this article, we use the notation 
^/i ^ gM(^) if a = expX G Ac. We recall that 

n 

(1.12) Gc \ iVcAci^c = {^7 G Gc I n fM = 0} • 
(see 12], Lemma 3.4). 
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Lemma 1.2. N^Kc = {geGc\ fj{g) = 1 for all l<j<n}. 

Proof. This follows from (irTT|l and (ITT^ . □ 

We will often view fj, or more generally it left translates, as a function on Xq. We will 
also, without further comments, view the function g i— fj{g~^z), z G Xq as a function on 
S. With that in mind we have: 

Lemma 1.3. Let ^ G H and x G Xc- Then 

E{0 = {zeXc\fj{r'z) = l for all 1 < j < n} 



and 



S{x) = {g E E \ fj{g x) = 1 for all 1 < j < n} 



Proof Notice that E{g ■ ^o) = gE{^o) and S{g ■ Xo) = gS{xo). We can therefore assume that 
^ = and X = Xo- Now, the claim is a reformulation of Lemma fl.21 □ 



1.3. Some G-submanifolds of S. We define the G-space of real horospheres in X as 

= G/MN . 

Then S]r C S = Gc/MqNc is obviously a totally real G-submanifold of H and the right 
A-action leaves invariant. 

Let T = exp(ia) C Gc and note that Ac = A x T; note that F = K HT. We contrast 
with the G x Ac-invariant subset of H 

(1.13) Eo = G-^o-Ac = GAc-^o- 

Proposition 1.4. T/ie following assertion hold: 

(1) T/ie majj 

(1.14) K/M xp Ac-^Eo, [kM,a]^ ka-^o 

is a real analytic isomorphism. 

(2) The map 

x^ T -> So, [gMN, t] ^ gt ■ 
is a G-equivariant real analytic diffeomorphism. 

Proof (i) follows from the fact that G = KAN and NAc C AqNq. Finally (ii), is a 
consequence of (i). □ 

Note that ()1.14j) describes a natural C-R-structure on Hq of C-R-dimension dim A and 
Ci?-co dimension dim K/M. 
Define a tube domain in Ac by 

T(f2j^) = exp(a + i^n) = Aexp{iQ,H) ^ a + i^n 

and set 

(1.15) S+ = Gexpitnn) ■ Co = i^T(fi^) • . 
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Then is a real-analytic, G-invariant open submanifold of Sq. In particular S+ is a CR- 
manifold. The coordinate decomposition of Hq slightly simplifies for S+. 

Proposition 1.5. For S+ the following assertions hold: 

(1) The map 

K/M X Tiytu) S+, (fcM, a)^ka- 
is a real analytic isomorphism. 

(2) The map 

ErxQh^ H+, {gMN, Z) ^ g exp(2Z) ■ 
is a G-equivariant real analytic cliff eomorphism. 

We conclude this section with a remark on the structure of H+. 

Remark 1.6. (Shilov boundary of S+) The map 

Sm dE+, gMN gzn ■ Co 

identifies as the Shilov boundary of S+. In this sense Sr parameterizes the real 

horospheres on Y (see also Lemma fl . 71 b elow) . 

1.4. Horospheres without real points. The aim of this subsection is to show that horo- 
spheres corresponding to do not contain real points, i.e., are disjoint form Y. 

Recall from Subsection 11.11 that we identify Y = G/H with the (Shilov) boundary orbit 
G ■ Ho C Xc of yo = zh ■ Xo in Gc/Kc. Define the parameter set of horospheres without real 
points by 

(1.16) s,r = {^GH|F(Onr = 0}. 

The following statement should be compared to the complex convexity Theorem p.4|) :it 
means that convexity breaks down at the extreme points of Qh- 

Lemma 1.7. Let U = Uwew ^^wH . Then U ■ i/o is open and dense in G ■ yo and 

G-Vof] NcAc ■Xo = U-yo = NAWzh ■ Xo . 

Proof. It is a special case of a Theorem by Rossmann-Matsuki (cf. [21]) that lA is dense 
in G. Hence U ■ yo is dense in G ■ yo. As zjIHcZh = (cf. (II. 3p ). it follows that 
U ■ yo = NAWzh ■ Xo- It remains to show the inclusion 'O" for the first asserted equality. 
But this follows from (fTT^ . □ 

We can now prove the main result of this subsection. 

Theorem 1.8. H+ C Snr- 

Proof. We argue by contradiction. Note that E{S,) P^Y ^ for some ^ G means that 
there exist Z e VLh such that 

Gzh ■ Xo n exp(zF)A^c ■ 7^ . 

Now exp(zy)A^c ■ Xo = Ncexp{iY) ■ Xo C Ncexp^iQn) ■ Xo and the assertion follows from 
Lemma 11.71 □ 
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1.5. Real forms of E{^) and S{z). In this last part of this section we introduce certain 
G-invariant real forms of the complex manifolds ^ind S{z). 

We begin with the horospheres. For ^ = ga ■ ^ with g E G and a G exp^iflfj), 
define 

(1.17) E^i^)=gNa-XoCE{^). 

Then E^{^) is well defined, G-invariant and a totally real submanifold of E{^). Further, the 
assignment 3 ^ E^{C,) is G-equivariant. 

Next we consider S{z) ~ Kc/Mc. Because of the relation Kc = zJ^HicZh there are two 
natural real forms. Accordingly we define for z = ga ■ Xo E D: 

(1.18) S^{z) = gaK ■ and S^{z) = gazJj'Hzu ■ ■ 

Obviously S^{z) and S^{z) are G-invariant totally real submanifold of S{z) = gaK^-Xo and 
the maps D 3 z S^{z) and D 3 z ^ are G-equivariant. Note that S^{z) ~ H/M 

as manifolds. 

1.6. Invariant measure on Y. Lemma 11.71 allows for a natural normalization of the in- 
variant measure on Y. Assume that invariant measures on G, A and have been fixed and 
let Wh = Nxnui.'^) / ZnnKi.^) be the small Weyl group. By Lemma ITTI the union 

U= U ANw ■ Vo 

is disjoint open and dense in Y . As the complement is an analytic set, it follows that Y \ U 
has measure zero. We can normalize the invariant measure on Y such that for all / G L}{Y): 

I f{y)dy= y2 f{anwyo)dadn. 

2. The Frechet module CR°°{E+) 

In this section we use the right A-action on Hk and S+ to define G-submodules of the 
smooth A-covariant functions on Sk respectively Gi?-functions on S+. Those modules are 
the standard realization respectively a CR-realization of the space of smooth vectors in the 
principal series representations given by induction from the right. Note that later we will 
use the induction from the left. 

Recall, that A acts on the space of horospheres from the right. This action induces a right 
regular representation of A on any function space on Sk, or any other right invariant set 
of horospheres given by 

(i?(a)/)(0 = /(e-a). 

Let p = 1/2 ^^g5.+ (dimg") ■ a. Let A G a^. 

The index x will denote the subspace of (A — p)-covariant functions. In particular 

G°°(Hk)a = {fe G°°(Hk) I (Va G A) R{a)f = a^-^f} . 
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We recall that G acts C°°(Sr) by left translations in the argument 

for g E G, f E C°°(S]k) and ^ G H^. The so obtained representation {L,C°°{Er)x) is the 
smooth model of the spherical principal series with parameter A. 

Write C-R°°(S+) for the space of smooth Ci?-f unctions on S"*" and set 

CR^iE^), = {fe I (Va G A) R{a)f = a^~^f} . 

As characters on A extend to holomorphic functions on T{Qh), it follows that the restriction 
map 

(2.1) ResA : ^ C°°(Hm)a, f ^ f\s^ 

is a G-equivariant topological isomorphism of G-modules. 

2.1. C-R-realization of the if-spherical holomorphic vector. For each A G we 
define a certain if-invariant element fx G Ci?^°°(S+)A which was called the if-spherical 
holomorphic distribution vector in |llj. The generalized function fx is defined by 

fxiO = air'^n'r' (e e H+) . 
We notice that on the dense subset 

SV= U HwT{Qh)-^o 

of the function belongs to CR°°{'E'_^)x and is given by 

fx{hwa-Q = {w~'zHw)^-'a^'r 

For 3?A ^ 0, this function is actually continuous on S+ and the meromorphic continuation 
in A as a distribution is achieved with Bernstein's theorem There are no singularities on 
the imaginary axis ia* and we arrive at a well defined analytic assignment 

,a* ^ , X^fx 

(cf. dH, Th. 2.4.1). 

3. The holomorphic horospherical Radon transform 
The real Radon transform on X is the G-equivariant injective map 

(3.1) 7^M : 5(X) ^ C°°(Sm), n^{f){g-^o)= j f{gn-Xo)dn{ {g e G)) . 

J N 

The purpose of this section is to show that TZ^ has a natural extension to a G-equivariant 
map 

7^ : n\D)a GR°°{E+) 
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which we call the holomorphic horospherical Radon transform. Here 1H?{D)q ^ L'^{X) is 
a dense a subspace of the most-continuous Hardy space Ti?{D) C 0{D) of LP'iY) (cf. [llj). 
On the infinitesimal level this extension is related to the previously established fact ()2.1|) . 
i.e. C°°(Sir)a is canonically G-isomorphic to CR°°{^+)\ via restriction. 

This section is organized as follows: First we have to recall some facts about the Fourier 
analysis on X, in particular Arthur's spectral characterization of the Schwartz space C{X). 
Subsequently we give a brief summary on the most-continuous Hardy space 1H}{D) of jTT]. 
Finally we define the holomorphic horospherical Radon transform TZ and discuss some of its 
properties. 

3.1. Fourier analysis on X. We recall the compact realization of the principal series 
representations. Let B = M\K. For A G define a representation vr^ of G on L'^{B) 
by 

(3.2) 7rxi9)fiMk) = a{kgY-^ f{Mk{kg)) . 

Then (tta, L'^{B)) is unitary if A G ia* . We write Tlx = L'^{B) to indicate the dependence of 
the G-action on A. Let a+ = {if G a | (Va G A+) a{H) > 0} and 

a; = {A G a I G a+) X{H) > 0} . 

Denote by Gj. the reduced dual of G and by Gj-sp the spherical reduced dual. Then ia\_ 3 
A I— »• [tta] G Grsp is an isomorphism of measure spaces. Here [ttx] denotes the equivalence 
class of Tlx- We have 

dX 



(3.3) L'{X) ~ / n 



c(A)| 



2 



where c(A) is the Harish-Chandra c-function. To explain the above isomorphism, we need 
some basic fact on the Fourier transform on X. For that, recall that a : X ^ A denotes 
the A-projection with regard to the horospherical coordinates X = NA ■ Xo — N x A. Set 
X = B X ia\. and define a Radon measure dfix on X by 

djJxib, A) := db- 



|c(A)P 

For / G L^{X) n L'^{X) define its spherical Fourier transform f : X —>■ C hj 

/(6,A) = / f{x)a{bxy~^ dx. 



X 



We will also write Tx{f) for /. We can normalize the left-Haar measure dx on X such that 
the Fourier transform extends to an unitary isomorphism " : L'^iX) L'^{X ,dfix)- If / 
is rapidly decreasing (see exact definition in a moment), then the Fourier inversion formula 
holds pointwise: 

f(x) = [ fib, \)a{bxY-^^ dfxxib, A) (x G X) . 



X 
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For A G ia* define fx E L'^{B) hj h ^ fx{i>) = /(^j-^)- Then the isomorphism in ()3.3|) is 
given by 

L\X) 3f^ (A), e Hx 



In the following we will also need the operator valued Fourier transform. If 7i is a Hilbert 
space, then B2{'H) ~ T-L^Ti* denotes the Hilbert space of Hilbert-Schmidt operators on 7i. 
Write 

dX 



J ia*, 



|c(A)P 

for the /T-spherical spectrum in L'^{G). Recall that the isomorphism is given by the operator 
valued Fourier transform JF(/)(A) = f{x)TTx{x) dx, f G L^{G) fl L'^iG). The inverse map 
is 

f{g) = ! TrK(r^)^(/)(A)) '^^ 



.^al ,c(A)r 
The constant function vk,x = Is defines a normalized i^-fixed vector in Tix. Assume that 
/ G L\G) n L2(G)sph. Then, because J^(/)(A) = T{Rkf){X) = J^{f){\)7rx{k), it follows, 
that 

(3.4) = {v,VK,x)Hm>K,x = {v,VK,x)fx. 

For X = ki exp{Z)k2 G G, with Z E a and ki, k2 G K, let cr{x) = —B{Z, d6{l){Z)), where 
B is the Killing form on q. Denote by U (g) the Universal enveloping algebra of q and by ipo 
the basic spherical function. For D,E e f/(g), s G M and / G C°°{G), let 

Pd,eM) ■= sup \LDREfix)\(poixy^{l + a{x)y . 

x€G 

Then C{G) is the space of smooth functions on G such that PD,E,s{f ) < oo for all such E, D 
and s, cf. §9 . We set 

C(G),ph = C(G')nL2(G')sph. 

For T E K we write |r| for the norm of the corresponding highest weight. If r G -ft', then 
we write L'^{B)r for the subspace of L'^{B) which transform under r. We denote by D(m*) 
the algebra of all constant coefficient differential operators on o* and set S{ia*^) = {f\ia* \ 

We cite a theorem of Arthur [1 , p. 4719, specialized to the spherical case: 

Theorem 3.1. The operator valued Fourier transform J-" is a topological linear isomorphism 
from C(G')sph onto 

{A{-)e / B2{nx) --^ I (V^;, w G L2(5)K-fin) {A{-)v, w) G S{iaX) , 
VD G ©(^a*), Vn G No sup + l^ir(l + kir(l + \^\T < oo} . 

xe^aX,:.,rek \\v\\ ■ \\w\\ 

v<=L^(B)a,w(^L^(B)r 
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3.2. The most-continuous Hardy space. We recall now the spectral definition of the 
Hardy space li}{D) from [TT]. For v G 7i\ define an analytic function f^^x on X by 

fv,\{x) = {T^xix~'^)v,VK,x) = {v,nx{x)vK,x) ■ 

Let us denote hj z ^ z the complex conjugation in Gc with respect to G and recall that 
A extends to a holomorphic function f^^x on D via 

fv,x{x) = {v,7Tx{x)Vk,x) 

for X E D, cf. [11] and [15], Proposition 2.2.3. In particular 

fvAga-Xo) = {7^xig'^)v,7rxia'^)vK,x) 

forgEG and a G exp^iflff) 

Define a generalized hyperbolic cosine function on ia* by 



(3.5) cosh(A) = J2 

for A G ia*. Define a measure fi on ia*^ by 

(3.6) dniX) 



cosh(A) ■ |c(A)|2 ■ 

With this preparation we can define the unitary representation {L,1H?{D)) of G by 

{L,n\D))= / {7cx,nx)dii{\). 

Thus T-C'^{D) is the Hilbert space of all measurable functions s : ia*^_ L'^{M\K) such that 
= J.^, ||'5(A)|p (i/i(A) < cxD. In the sequel we often write write sx for s(A). Let us denote 

by II ■ IliT the norm on Ti^^D). Recall from ^T] that the map 

$ : n\D) ^ OiD), s = (sx) ^ (x^ [ fs,,xix) d/i(A) 



is a G-equivariant continuous injection. In the sequel we often view 1H}{D) as a subspace 
of 0{D)\ we call T-C^{D) the most- continuous Hardy space ofY. This notion is motivated 
by the main result of which states that there exists an isometric G-equivariant value 
mapping 

b:n\D)-.LUY), f^bif) 
which is isometric onto a multiplicity free subspace of L^^(F). 
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3.3. The Fourier Transform on X and the Hardy space. The definition of li?{D) in 
the previous subsection does not use the Fourier transform on X. But the foUowing Lemma 
shows that the space T-C^{D) has a natural description in terms of the Fourier transform. 

Lemma 3.2. Let f G 1H?{D). Then the following assertions hold: 
(1) f\x G L\X) and 



f\x{h, A)cosh(A) a{hz)^+P dfx{b, A) {z e D) 



\f\xihA)? ■ cosh{X)diix{hA) > ll/l 



X 



{X) ■ 



(2) /// = $-1(sa), then 



(/I 



x)\ 



cosh(A) 

(3) For a = exp{iY) G exp^iQn) let fa : G ^ C by fa{g) = f{ga-Xo)- Let Q C exp^iQn) 
be compact and such that a E Q. Then there exists a constant Cq > such that 

WfaWh^iG) < CQllflln 

Proof (1) and (2). Let / G H^{D) and / = /.^, fs^,xdfi{X). Then obviously we have (2), 
i.e., 

(3.7) 

and 



/ 



dX 



,^cosh(A) |c(A)P 



> 




d\ 



co«h(A) 

2 



dX 



\ciXW 



Thus fix e L^{X) and we can write f\x = J;^f\^{b, X)a{b ■ )P+^dbj^. Equation (ITTj) 

implies that f\x{b,X) = SA(&)/cosh(A) or sx{b) = A)cosh(A) for almost all A. This 

finishes the proof of (1) and (2). 

(3) We recall Faraut's version of the Gutzmer identity [Hj 

(3.8) / \figa.x,)\' dg= [ iJ^^b, X)\'Ma') dby^ 

Jg jx \^\^)\ 
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where (px{a^) is the analytically continued spherical function given by 

^^(a^) = I \a{kaY^^\^ dk 



K 



(cf. ^n|; Sect. 4). Now for a compact subset Q C exp(ifi/^) there exists a constant Cq > 
such that 

(3.9) (VA G ia*) (fxia^) < CQCosh(A) 

for all A (cf. Lemma 2.1) and the assertion of the lemma follows. □ 

In order to define the Radon transform for functions in the Hardy space we first need a 
technical fact, interesting on its own. 

Let ^ Hx djj{\)^ denote the space of all sections (sa) such that for all v E ^^i^) K -Unite 
and 

(3.10) (VD G ©(2a*),Vn G No) sup ^^^^^^^(1 + |A|)"(1 + |r|)" < cx) . 

\eia';^,TGK \\V\\ 

Then we set 

(3.11) n\D)o = 1^ 1^^"^ Hx dfi{\)j j . 

Theorem 3.3. Let f G 'H^{D)q. Fix z G ^(^]//). Then the function 

G3g^ f{gz ■Xo)eC 
belongs to C{G). Moreover, the following functions are locally hounded on T{Qh)-' 

(1) ^ ^ Iclfidz- Xo)\^ dg 

(2) In \f (^^ ■ ^o)\ dn 

Proof. Without loss of generality we may assume that 2; = a G expliQu). In the sequel we 
often identify / with f\x, a right iiT-invariant function on G. Let v,w E L^(i?)x-finite- Then, 
by (IS3I) and Lemma Eil 

{J^{RJ){X)v,w) = {J^{f){X)n,{a)v,w) 

= {7rxia)v,VK,x){fx,w) 

{v,TCxia)vK.x) , \ 
= cosh(A)^ 
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Let US write F{X, v, w) := {J-'{Raf){\)v, w). It is clear that F is smooth in the A-variable. 
In order to show that g f^ga ■ Xq) belongs to C{G) we use Arthur's Theorem 13.31 we have 
to show for all n G Nq and D G ©(ia*) that 



(3.12) 



sup + |A|)-(1 + |r|)'^(l + \a\r < oo 

uSL2(fl)^,tuei2(B)^ 



We use the expression for F(A,f,w) derived above to compute its derivatives: For fixed 
we find according to Leibniz a finite set of Di, D[ . . . , D^, D'^ in ©(ia*) such that 



TV 



(3.13) 



DF{\,v,w) = Y, 



{v,TTx{a)vK,x) 



w 



cosh(A) 

According to ()3.10p . for all D G D(za*), n G No the following estimate holds: 



(3.14) sup ^^^^f^^(l + |A|)"(l + |a|)"<oo. 



\W\ 



Now, after combining ()3.12j) - ()3.14p we are left to show for all D G D(zo*), n G Nq: 



(3.15) 



sup 



D 



cosh(A) 



\V\ 



;i + |r|)" < oo. 



To establish ()3.15|1 . we first note that TT\{a)vK,x is an analytic vector for the representation. 
Now if w G Hx = C'^{M\K) and w = Ylrek'^T expansion in i^-types, then we 

recall from ^20,, Th. 2.2 (1), that there exists a 5 > such that 

To be more precise, given 5 > sufficiently small, there exists a ball U arround 1 in 
such that TTx{t)w exists for all t G f/ and 



\Wr\\ < (sup ||7rA(t)w| 

t&U 



■ e 



-5/2\t\ 



Coming back to our original situation where our analytic vector is w = TTx{a)vKx, we 
obtain that 'n'x(t)7Tx{a)vKx exists for all t eU. It follows that 'n-{GUaKc)vK^ exists. As the 
crown is a domain of holomorphy for principal series representations (cf. T^), we obtain, 
by continuity, a compact neighborhood Q of a in exp^ifln) such that UaKc C CQK^. By 
the very nature of the principal series, it is easy to see that U can be chosen independent 
from A. Hence we get a C > such that for all A G ia*, r E K and v G L^(i?)^ 

/Qi«N \{v,T^x{a)vK,x)\ ^ , I II II 

(3.16) T-- <C;(l + |r|) • sup ||7rA(6)i;x,A|| • 
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Moreover, sup^pn lll^i^l^S^ is uniformly bounded in A by (13.91) . This, in combination with 

^ •v/cosh(A) 

fj3.16|) . proves ()3.15p for the case of D = 1. Now, if D is of order k, we first observe that 

(VA; G K){yb G Tinn)) [Dnx{b)vK,x] (Mk) = pk{{X + p){\oga{kb)) {nx{b)vK,x) (Mk) 

for a polynomial pk of degree k and independent from A. It follows from the complex 
convexity theorem ()1.4j) that 



sup sup |pfc(A + p)(loga(A;6))| < C ■ A/cosh(A) 

Furthermore the decay of ^^^j^^^^ is not affected by differentiation. Therefore we obtain ()3.15p 
for all D. 

Moving on to (1) and (2), we observe that statement (1) is Lemma l3.2| part 3; part (2) 
follows from the already established fact in conjunction with Lemma 22 in [I5j. □ 

3.4. The definition of the Radon Transform. Denote by the vector space of 

continuous C-R-functions on S+, i.e. the space of continuous functions on S_|_ ~ K/M x 
T{Qh) (cf. ()1.14|) ) which are holomorphic in the second variable. 

Lemma 3.4. Let f G 1H?{D)q. Then the assignment 



I f{gna ■ Xo) dn ^ C {g E G, a G exp{iilH)) 
Jn 



3 ^ = ga ■ C.O ^ a 
defines a C R- function on H+. 

Proof. It follows from Theorem 13.31 that the right hand side is a continuous function. It 
remains to show that is a Ci?-function. For that let g = kb ioi k E K and b E A. The right 
hand side becomes 

Jn Jn 
and the holomorphicity in ab follows with Theorem 13.31 □ 

In view of this lemma, the prescription 

7^ : n\D)o ^ f^(^^ = ga.^,^ a~^f> £ f{gna ■ x„) dn^ 

is a well defined and continuous G-equivariant map. We call TZ the holomorphic horospherical 
Radon transform. 

Remark 3.5. (a) We recall the real Radon transform on X from p.ip .Now if / G T-1^{D)q, 
then f\x G L'^{X) by Lemma Thus, for g E G, we get 

nf)i9-Q = T^M\x)i9-Q. 

In other words, the holomorphic Radon transform restricted to Sjr agrees with the real Radon 
transform of the restricted function on X. 
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(b) Notice that E{^) (ID for ^ G contains the real horosphere E^{C,)- The holomorphic 
Radon transform TZ then writes as 

nfm = [ fio du^io 

with du^ equals a~^''-times the measure on -Eir(0 obtained by the natural identification of 
the real horosphere -E'r(0 with A^. It is clear that any other A^-orbit in E{^) fl D would yield 
the same result. 

If the function / G 1H?{D)q is left /^-invariant, then we can define the holomorphic Abel- 
transform by: 

A{f){z) = [ f{nz ■ Xo) dn {z G T{Qh)) • 

J N 

Note that A is just the restriction of the holomorphic Radon transform to i^-invariant 
function (modulo the 2;"''- factor). Further let us remark that A gives a continuous mapping 

A : H\D)^ ^ OiTinH)^, A{f){z) = z-P [ f{nz ■ Xo) dn . 

Jn 

4. The holomorphic Radon transform as Cauchy integral I: The 

HYPERBOLOID 

In this and the next section we will show (for an appropriate class of Y^s) that the holo- 
morphic Radon transform on the NCC-space Y can be expressed as a Cauchy type integral. 
For that purpose it is instructive to explaining the example of the hyperboloid first. For 
earlier treatments of the hyperboloid with alternative methods we refer to [7] , [S] . We start 
by recalling some standard function spaces on Y. 

4.1. Function spaces. Let F be a NCC-space. For g E G let Q{g) = ipo{gT{g)~^Y/'^. 
Then G is left K-invariant and right if-invariant. For g = kexp{Z)h with Z E a define 
\\g ■ yo\\ := ||Z||, where ||Z|| = ^y^T ad{Zy. Let D G U{g), were U{g) is the enveloping 
algebra of Qc, and view L^i as a differential operator on Y. For G N and / G C°°(y) define 

PnMf) = sup ec(y)-^(l + \\y\\r\Lnf{y)\ . 

Then the Schwartz space C{Y) is defined as the space of smooth function on Y such that 
Pn,D{f) < cxD for all n and D. It is well known, that C{Y) C L^(F), but C{Y) is not 
contained in L^{Y). We will therefore need a smaller space to make sure that the Cauchy 
integral exists. For that, define for r > the space 

SriY) := {/ G C^iY) I (yO G Uig)) supe'^ll^ll|L^/(i/)| < 00} 

yeY 

and 

S{Y) ■.= []Sr{Y). 

r>0 
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Then S{Y) C L\Y) f] L\Y) and C^iY) C S{Y) C C{Y). The space S{Y) is called the 
(zero) Schwartz space, cf. . It follows from Theorem 3 in [H] and our spectral definition of 
the space H^{D) that 

n'{D)oo := {/ e n\D), I / Mnite, h{f) E 5(F) 

is dense in H}{D). Here used the fact that elements in T-C^{D)q have boundary values on 
Y (cf. [TT, Sect. 3 for a similar argument). In particular we have that every element 
/ G li?{D)QQ is integrable on Y , has a holomorphic extension to D, and that the integral 
f{anw -i/o) dn is well defined for all a G A and w G W. We will use this without comments 
in the following. 

4.2. The Radon transform and Cauchy integral on the hyperboloid. Assume that 
n > 2 and let G = SOe{l,n) be the Lorentz group. Let us fix our choices for the groups A, 
N and K. For the maximal compact subgroup we take 



K=l^kn=(l SO(n)| ~ SO(n) 



Next, for 2; G C we set 

cosh z sinh z 

In-l 

sinh z cosh z 
and 

A = {at\t eR} and Ac = {a^ \ z e C} . 

Note that a = M.Z and az = exp{zZ) with Z = -Ein+i + -E„+ii. The only positive root is a, 
determined by a{Z) = 1 and hence Zh = \Z. We also have, that p = ^^a. 
Further, for v G C"^^ and (f , v) = X]j=i '^j'^j define an unipotent matrix 

riv = \ V l„_i 

Then and Nc are given by 

N = {n^\ve W-^} and Nc = {n^ \ v e C""^} . 
Define a quadratic form 

ri 

Z,W\-^Z-W = ZqWq — 

J=l 

on C"+^ and let 

□ (Z) = _ ^2 _ _ _ _ _ ^2 ^ ^^^^ . . . , Z.)^ G C"+^) 
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be the corresponding quadratic form. We define the real and complex hyperboloids by 

X = {x e M"+^ I □(x) = l,xo> 0} 

and 

Xc = {z G C"+i I □(z) = 1} . 
As a common base point for X and Xc we take Xq = (1,0,..., 0)^ and note that the map 

Gc/Kc^ Xc, gKc^g{xo) 

is a Gc-isomorphism which identifies G/K with X. 

We have that • Xq = (cosh(2;), 0, . . . , 0, sinh(z))^ and hence yo = -Zij • Xq = (0, . . . , 0, i)^. 
It is clear that the stabihzer of jo is 

^= {(o l) I ^eSOe(l,n-l)| ~SOe(l,n-l). 

We have therefore with this identification: 

D ^ {z^x + iy e Xc\ □(x) >0,xo> 0} 

and 

Y = ^(yo) = {iy e | D{y) = -1} . 

Set 

s = {CGC^+MC7^o,n(c) = o}. 

If = (1,0,..., 0, 1)"^ e S, then the stabilizer of is McNc and the map 

Gc/McXc^S, gMcNc^g-^o 
is a Gc-isomorphism. Now the Ci?-submanifold S+ C 5 is described as 

S+ = G|(e^*,0,...,0,e**)^| |t|<|,tGR} 

= {C = e + ^r/GS:n(O = n(r7) = 0; e^Ojo. 

We will also use certain G-subdomains of S+: for < c < | set 

= G{(e'*,0,...,0,e^y I \t\ <c,teR} . 

In order to define the Cauchy-transform we need to establish a simple, but important, 
technical fact. 

Lemma 4.1. For all ^ G S+ and y one has 

More precisely, for all < c < ^ there exists a C > such that 

(Vy G y)(Ve G S,) |l-^y| >G. 

Proof. By G-equivariance of the form we may assume that ^ = e**^o- Let y = iy for y G W"'^^. 
Thus ^ - y — ie^^^o ■ Y with • Y £ I^- As \t\ < |, the assertions follow. □ 
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We now define the Cauchy-kernel function 

In view of the previous lemma, this function is defined, continuous and bounded on all 
subsets Sc X y for c < |. Moreover, /C is a C-R-function in the first variable and G-invariant, 
i.e., ]C{g ■ ■ y) = /C(^, y). In particular, the function 

G3g^lC{g)=}C{U9-yo)eC 

is left A'^-invariant and right if- invariant, a fact that we will use in a moment. We will 
therefore identify /C with a function on Y without further comments. A simple calculation 
shows that 

(4.1) JC{g) = ——^ ^. 

1 - H5'0n - gnn) 

We have Wh = {1}) and W = {1, e} where e = — 1 on a. As e corresponds to the matrix 
w = (^"^Q^ ^ ^ follows that 

(4.2) /C(a,) = -^-^ and IC{a,w) = ^ . 

Write S{Y) for the Schwartz-space on Y. Henceforth we will make the assumption that 
n is even and define the Cauchy - transform by 

C:S{Y)^CR{E+), C(/)(0= / -^^dy= [ f{y)K{^,y)dy 



jY^-i-y JY 

where dy denotes the G-invariant measure on Y from Subsection 1.6. 

Remark 4.2. In the following we have to raise complex powers of elements z G which 
are in the boundary of ex^i^^n)- This is not a problem as the map 

exp : 2VLh A^, Y i— > exp(iy) 
is injective; a fact which holds in full generality. 

Theorem 4.3. Let G = S0(r2, 1) with n = 2k even. Let f G li?{D)oo. Then, up to 
normalization of measures on A, one has 

c{fm = {-if-'2n.n{fm (eG5+). 

Proof. Since both C{f) and 7^(/) are C-R-functions, it is sufficient to show that both coincide 
on G/MN C S. Moreover, by G-equivariance of both maps, it is in fact sufficient to show 
that 

(4.3) C(/)(eo) = (-l)'-^27^.7^(/)(eo). 

Using (1121) and that = (-l)^-^^ and z''^'' = z^^ = (-1)^2 we get: 
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C{f){Q = J^f{y)-IC{y)dy 

= / / f{anw ■ Yo) ■ lC{anw) dn da 

= / / f{anw ■ Yo) ■ IC{aw) dn da 

= / / f{anwzH ■ Xo) ■ K,{aw) dn da 

= / / f{anz^ ■ Xo) ■ }C{aw) dn da 

= J2 [ [ f(^^^H ■ Xo) ■ {z"^)'^" ■ {z'^ fP ■ lC{aw) dn da 

= 5^ /w)(az]^-eo)-(^]^)'^-/C(au;)da 

Consider the strip domain S = {z E C \ \lmz\ < By our assumption on /, the 
function 

^ ^ 1 - e-^ 

defines a meromorphic function F on int S which extends continuously up to the boundary 
and which has at most a simple pole at 2; = 0. Thus the Residue theorem yields that 

C(/)(Co) = (-l)'27rz ■Res(F,0) = (-l)^-i27r ■ 7^(/)(eo) 
and this concludes the proof of our theorem. □ 

Remark 4.4. (a) We mention that the geometric pairing ^ ■ y can be expressed using the 
previously defined power functions fj (cf. Il.iup : 

^y = /l(rt)■ 

(b) The assumption that n is even is not a real restriction as one can slightly modify C so 
that it works for all parities (see our discussion in the next section). 

5. The holomorphic Radon transform as Cauchy integral II: Cayley type 

SPACES 

The technique used for the hyperboloid in the previous can be used for NCC-spaces of 
Cayley type as well. Let us recall that Cayley type spaces are those which are associated 
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to Euclidean Jordan algebras V: i.e. X is a tube domain associated to V and H is the 
structure group of the cone of squares in V. In terms of the set of restricted roots S, this 
means that S is of type Cn, say 

S=|^(±7,±7,)|l<2,i<n|\{0}. 
We assume now that Y = G/H is oi Cayley type. Define Tj G a by ■jiiTj) = 6ij, then 



71 71 

2' 2 L 



(5.1) = 

As a basis of S we shall choose 

n= |^(7i -72),---,^(7n-i -7n),7^ 

Obviously ui = —71 is a fundamental spherical lowest weight and accordingly fi{g) = 
{7ii{g)rij,vi) defines a holomorphic function on Gc with fi{g) = a{g)~^^ for g e N^AcKc. 
The analogue of Lemma f4. II now reads as follows. 

Lemma 5.1. Let the notation be as above. Then the following holds: 

(1) fi{exp{zQH)GzH) CC\R\ 

(2) For all < c < 1 there exists C > such that 

{\/g G G){\/Z e^H) |1 - Mexp{icZ)gzH)\ >C. 
Proof. First it is clear from (j5.1|) that 

(5.2) expi^VLuT^ = G C I Re;z > 0} . 
Next recall that lJuiew ^^'^H is dense in G and that 

(5.3) fiinawh) = d^'z^^^ G M+{-i, i} . 

Combine (j5.2j) and (j5.3|) and the assertions follow. □ 
For < c < 1 define a G-subdomains of by 

(5.4) Sc = G exp(icllH) • • 

Note that — 7j, j 7^ 1 is not a fundamental spherical lowest weight. Therefore, for 1 < j <n 
we define a meromorphic function on Gc directly by 

h,{g) = a{g)-^^ ioi geN^AcK^. 

Note that hi = fi and, in the same manner as in Lemma f5.H one establishes that 

(5.5) hj{exp((iVLH)GzH) C C\M^ U {00} 
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In particular we see that the prescription 



n ^ 



defines an analytic function, CR in the first variable and bounded on all subsets Hp x Y. 

Remark 5.2. Alternatively, the kernel /C can be expressed in Jordan algebra terms. Let V 
be the Euclidean Jordan algebra associated to X and W G V its cone of squares. Form the 
tube domains = V ±iW C Vc- Then X = and D ~ T"*" x T~ with X realized in D 
via the map x ^ {x,x). Write Aj for the power functions on Vq (i.e. generalized principal 
minors). Then, on D, one has 

hi(z,w) = — for (z,w) e D 

with the understanding that Aq = 1 Thus /C, when considered as a function on D, is given 

by 

_ Ai(2:-w)-...-A^_i(^-w) 

^ ' ^ n;=i(A.-i(^-^)-A,(.-^))- 

However, /C is not our Cauchy-kernel yet and some small modification is needed. For 
that recall the decomposition S+ ~ G/MN x exp(if2j7). For a unitary character % G T/F, 
where F — K r[T is the canonical finite 2-group as usually, define the space of x-^'W^^s^ed 
C R-functions by 

(5.6) Ci?^(5+) = {/(^a • Q = /i(5a • Qx-\a) \ h e Ci?(S+)} . 
Let 7o = 7i + ■ ■ ■ + 7n- In the sequel we will fix x to be 

X = -2p + 7o 

and notice that % = 1 for G = Sl(2, M). For g G NcATKc write t(5') E T/F for the compact 
middle part of g and define the Cauchy-kernel /C by 

(5.7) Me,2/)=/C(e,|/)x(t(rt))- 

and notice that JC^ is defined whenever ^~^y G NcAcKc and, when defined, is in CR^ as a 
function of the first variable. We note that Tlx G-invariant and hence corresponds to a 
function of one variable K-xid) ~ ^xi^o, 9 ■ Uo)- As before, IC^ is N x if-invariant, and will 
be identified with left A^-invariant function on Y. 
We define the twisted Cauchy transform by 

Cx : S{Y) CRxiE^), C^(/)(0 ^ J^f{y)]Cx{C,y) dy 
and the twisted holomorphic Radon transform by 

Ux : n\D)oo ^ CRx{E+), f^(^^^ga-Co^ a"^" f{gna ■ Xo) dn^ . 
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We come to the main result of this section. 

Theorem 5.3. Suppose that Y = G/H is of Cayley type. Let f e 'H^{D)qq. Then 

Proof. Both and Tlxif) Ci?-functions, and so it is sufficient to show that both 

coincide on G/MN C S. Next, by G-equivariance of both maps, it is enough to show that 

(5.8) C^(/)(eo) = (27^r•7^^(/)(eo). 

We now get, as in the proof of Theorem 4.2, for the left hand side: 

J2 I ^x(/)(«^H ■ io) ■ {z'^hV ■ JC^az^ ■ Xo) da 

^ X! / '^((^^H ■ Co) ■ {zny" ■ ICiaz"^ ■ Xo) da . 
Specifically we have W/Wh — (^2)'* and z]P° = i'*sgn(w) 

se(Z2)" -^^^ Vi=i J 



Next observe that 



•^(exp + ^^if j • ^o) dt 

(n \ " 1 



Let us consider the multi strip domain S — {z & \ \lm Zj\ < |}. By our assumption 
on /, the prescription 



/ n \ " 1 

S3z^ 7^(/)(exp J]^,T, UQ-H 
\j=i J j=i 



e C 

e ^3 



defines a meromorphic function F on int S which extends continuously up to the boundary 
and with at most a simple multi-pole at zj — 0. Thus iteratively applying the the Residue 
theorem yields that 

CxiMo) = (-27ri)" • Res(F, 0) = (-27ri)" • n{f){^o) = (-2nirnMi^o) 
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and it concludes the proof of our theorem. □ 
6. Some remarks on the inversion of the holomorphic Radon transform 

The inversion of the real horospherical transform on X can be analytically continued to give 
the inversion of the holomorphic horospherical transform. The dual transform is given by 
integration over the real form of S{z). However, there is a second non-compact real form 
S^{z) of S{z) which gives rise to a different dual transform and inversion. This is the topic 
of this section. Mainly we will focus on G = S1(2,M). 

We begin with the definition of an appropriate function space. Let us denote by 
denote the space of Ci?-functions on S+ which extend continuously to G exp^ifln) ■ such 
that H 3 fighz^ ■ ^o) G C is integrable for all g & G. For those functions we define the 
dual Radon transform by 

^(s+)^c(y), (/.^(/.^ 

with 

4>\y)= [ f{ghzH-Qdh= [ f (y = g.y^eY). 

Clearly, this is a G-equivariant mapping. 

We would like to understand the relation between TZ and i— 0^. In this context we 
would like to mention the result in [TB] for the holomorphic discrete series: there exists a 
differential operator C such that {CTZ{f)Y = f ■ Hence it is natural to ask whether a similar 
statement would hold true for the most continuous spectrum considered in this paper. It 
will turn out that the situation different for the most continuous series in the sense that the 
inverting operator C is not a differential operator. We give a detailed discussion for the the 
basic example. 

6.1. The example of G = S1(2,M). For this paragraph we let G = S1(2,M) with the usual 
choicGS 

and K = S0(2,M). Let / G 7i'^{D)oo be a i^-invariant function. In the sequel we will 
identify with C via the assignment 

In this coordinates one has 

1/2 r(A/2) , , 2 ^TtA , /zTtAA 

We know that f\x G L'^i^) smd, as / is i^'- invariant, we can write 



fix) = \l /(^A)0a(x) (x G X) . 



Applying TZ yields that 
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2 

and thus 



nfYiVo) = \l I /(^A)a(^^i/i)''(i+^^) dX dh. 




'H 



r , f cosht smht\ i\ , -i , /^e 4 cosh t e 4 smhA 

JNow, tor n. = . , , 1 , G -n = oUell, 1) one has Zr. h = \ ,t . , , .-tt ,1 
y^smhr coshty v ' / n \^ e 4 smht e 4 cosht y 



and so ^ 

a(z^i/i)'' = ( ^] ' = e"*^ r 

V^lsinh^t + cosh2t)y (cosh2t)^ 

Therefore we obtain that 
Lemma 6.1. 

io„,„ „ , ,■>^,,,^ ir((i + 'a)/4)r(i/2) 



(cosh2t)^(i+'^) 2 ^' ^' ^ 2 r((3 + ^A)/4) 

Proof. Let us denote the integral on the left hand side by /(A). With the substitution 
u = cosh 2t we obtain 

f°° 1 1 

= ii?(l/2,(l + zA)/4) 

as g) = /~ - 1)^-1 du. □ 

Using this, we get: 

(6.2) n/ny^) = - f f{iX) ■ (^-)i?(l/2, (1 + zA)/4) dX . 
Define 

Ci(A) = e^(^-')5(l/2, (1 + 2A)/4) + e-^(^+*)5(l/2, (1 - tX)/A) 
and note that A ^ f{iX) is an even function. Thus ()(j.2p yields that 

(6.3) n{fy{y,) = l [ f{zX)-C,{X)dX. 

^ .Its 
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By the Fourier inversion formula, we have 

(6.4) fivo) = \l f{t\)My, ^ 



Now, from the special values of the GauB hypergeometric function we get 

MVo) = Fil/A + tX/A, 1/4 - zA/4, 1; 1) ^ 



2fi((3-a)/4, (3 + a)/4) ■ 
We therefore define 

r (X) = IZ^ 

B{{3 - tX)/A, (3 + tX)/4) |c(zA)|2 
and note that ()().4j) transforms into 

(6.5) f{y,) = \ [ f{zX) ■ C,{X) dX 

In the next step we want to compare the expressions Ci(A) and C2(A). If there would exist 
a differential operator C, then there should be a polynomial g{X) such that g ■ Ci = C2. 
We first consider 



with 

(A) = e 



r((i±a)/4)r(i/2) f r(i/2) 



r(3/4 ± zA/4) Vr(3/4 - zA/4)r(3/4 + zA/4) 
We focus on and obtain 



Ct{X) = ef 



r((i + zA)/4)r(i/2) f r(i/2) 



r(3/4 + iX/A) Vr(3/4 - iA/4)r(3/4 + iX/A) 
ef(A-.) . + a)/4)r(3/4 - zA/4) 
ef (^-0 ■ r((l + a)/4)r(l + (-1/4 - zA/4)) 
ef(^-) . (-1/4 - 2A/4)r((l + iA)/4)r(-(l + tX)/A) 



sin7r(l/4 + iA/4) 

Likewise we obtain 



-f(A+i) 

Cr(A) = C+(-A) 



sin7r(l/4 - iA/4) 
and so 
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^ ~ sin 7r(l/4 + iX/A) ^ sin 7r(l/4 - i\/A) 

i sinh7r(A/4 -i/A)^ i sinh7r(-A/4 - i/A) 

7rcosh(7rA4-zf)+sinh(^-if) tt cosh(-^ - if ) + sinh(-^ - ) 
i sinh7r(A/4 - i/4) i sinh 7r(-A/4 - i/4) 

= y • (2 + coth(^(A - i)) + coth(-^(A + i))) 
Now define g{\) by the requirement 

Now note that 



Ci(A + z) = - ■ ( 2 + coth(— ) +coth( — ^ - « 2 ) 
= ^2 + coth(— )-tanh(— 

= ^.12+ 



i \ sinh(^) 



and thus we get 



Further manipulation then yields that 

5(A) = 



iA sinh(^) 



4 1 - cosh(^ 



- • 2 + = ^ coth — 



and it is obvious that g is not a polynomial function. Since 

^7(A)Ci(A) = C2(A) 

it is now clear that there exists no differential operator £ which inverts the holomorphic 
Radon transform. However the function g{X) defines us a spectral multiplier which is a 
pseudo-differential operator which we now call C We summarize our discussion. 
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Theorem 6.2. Let G = Sl(2, M) and C the spectral multiplier defined by the function g{\) 
ix smh{i^) ^^^^ ^ ^ n^{D)o such that 7^(/) G J^(S+) one /ias 



4 l_cosh(^) ' 

f = {cn{f)y. 

7. Geometric definition of the Hardy space 

This final section deals with the structure of the Hardy space li?{D). It allows independent 
reading and is of independent interest. 

Initially, the Hardy space was defined spectrally (see [H]). Below we will show how to 
define the Hardy space geometrically, i.e. we give geometric definition of the norm on || ■ 
on 1H}{D) through G-orbit integrals on D. For that we start by recalling the orbital integral 
Oh and the pseudo-differential operator V introduced also used in [T7j . 

In this section Y = G/H can be an arbitrary NCC-space. 

7.1. G-orbit integrals on the domain D. For a sufficiently decaying functions h on D 
we define its G-orbit integral on D as the following function on i2QH 

OhitX) = [ h{gexp{tlx) ■ x,) dg (X G 2fi^,) . 
Jg ^ 

For / G TC^{D) we notice that |/p is a sufficiently decaying function on D, i.e. 0\f\2(iX) is 
finite for all X G 2Qh- Moreover, in view of ()3.8p we see that 0|/|2 has a natural holomorphic 
extension to a holomorphic function on the abelian tube domain T{2Qh) = ci-\-i2QH, namely 

(7.1) 0\f\2{Z)= f |/>,A)|VA(exp(Z))rf/x;,(6,A) [Z eT{2nH)) 

J X 

7.2. A certain pseudo-differential operator. Define a space J^{T{2Qh)) of W-invariant 
holomorphic functions on the tube domain T{2Qh) by the following property: / G J-'{T{2Qh)) 
if / can be written as 

fiZ)= [ MA)^A(exp(Z))^^ (ZGr(2n^)) 

where h G L^{ia*^,^^^jrd\). If Q C T(2^1h) is compact, then there exists a constant 
Cq > such that 

(VA G ia*) sup |v9A(exp(i2X))| < CQCosh(A) . 

As j^(^yp- is at most of polynomial growth, it follows that / is indeed holomorphic and W- 
invariant. Moreover, / is uniquely determined by h. It follows from our discussion that the 
prescription 



V : HT{2nH)) - 0(r(2f]H))^; {VF){Z) = [ h{X) ^ 



X(wZ) ^-^ 



|c(A)|^ 
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is a well defined linear mapping. 

Remark 7.1. The operator X> is a pseudo-differential operator and a differential operator if 
all root multiplicities are even. The operator T> is related to the Abel transform as explained 
in \n\i Remark 3.2. 

Example 7.2. In this example we discuss the operator V when the underlying group G is 
complex. Then P is a differential operator of a particularly nice form. 

If G is complex, then there is an explicit formula for spherical functions, due to Harish- 
Chandra: 

y..(exp(Z)) = c(A) ^-^^!^"; 

naeE+2sinha(Z) 

for all Z G T{2VtH)- The c-function has the familiar form 

n„eE+(A,a) ■ 

For each a G S let G a be such that a = {-jAa). Furthermore let da be the partial 
derivative on T{2Qh) in direction A^- Define a partial differential operator on T{2Qh) by 
= naGS+ ^a- Finally with J{Z) = Yia&Y:+ 2sinhQ;(Z) we declare a differential operator 
on T{2Qh) by 

V = const ■ (9e+ o J . 
with const = Ylae^+iP^^)- "^^^ relation 

is now obvious. 

7.3. The geometric norm. For a function / G 1H}{D) let us write for its norm as 

before. By Lemma f3. 21 this norm is given by 

(7.2) 11/11^,= f |/>,A)|2cosh(A)rf/x;,(6,A) 

J X 

The objective of this section is to express ||/||_h- in terms of the much more geometric orbital 
integrals 0|/|2. Our result is as follows. 

Theorem 7.3. Let f G W^iD). Then 0|/|2 G J^(T(2fiiy)) and the Hardy space norm \\f\\H 
of f is given by 



(7.3) 
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In particular, the Hardy space Ti?{D) can he defined as 

(7.4) n\D) = {fe 0{D) I 0,;p G ^(r(2fiH)) sup ^^J^';^|^^ < 00} . 

xe2nH \Vvh\ 

Proof. Fix / G li?{D). By equation (|7.H) we have 

0|^p(Z)= / |/>,A)|VA(exp(Z)) d^ixihA) 
J X 

for all Z G T(20jj). By the spectral definition of T-C^{D) it follows that 



hi\):= I \fib,\)\'db 

B 



defines a function h G L^{ia*^,^^^d\). Thus 0|j|2 G JF(T(2r2j|/)) and the apphcation of 
V to 0\f\2 yields 



Now notice that 



and 



sup 



^e^(™^)= lim 5^e^(*2»^) = |>VH|-cosh(A) 



toGW 



uGW 



The claim follows now from the spectral definition of the norm in 1-L^{D). Finally, back- 
tracking the steps of the proof readily yields ()7.4|1 . □ 

Remark 7.4. Some comments on the geometric Hardy norm 

\\f\\H= sup -^.(PO|,p)(Z) 

ze^iH \ yvH\ 

seem to be appropriate. Usually, in the theory of Hardy spaces (e.g. Hardy space on the 
upper half plane) one takes the supremum over a family of L^-integrals over totally real 
submanifolds. In our case one takes a supremum over G-orbits, which for the exception of 
the orbit through the origin, are never totally real. Secondly, we find the appearance of the 
pseudo differential operator T) interesting. In the context of Hardy spaces it might be novel. 

7.4. The iT-invariant case. In this subsection we give another description of the subspace 
1H?{D)^ using the Abel transform and the results in Appendix A. We start by noting the 
following simple connection between the Abel transform and the Fourier transform of a 
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i^-invariant function. For that we note first, that f{b,X) is independent of 6 G -B if / is 
iiT-invariant. We write then simply /(A) and note that / is W-invariant. Furthermore 

/(A) = / f{x)a{xy-^dx 
Jx 

f{na ■ Xo)a^^^^ dnda 

where JF4 stands for the Fourier transform on the abehan group A. Recall, that : L^{A) 
L'^{ia*, \W\~^dX) is a unitary isomorphism. Define a multiplication operator Da on ia* by 
Da{F) = c{—X)~^F and denote the corresponding multiplier operator on A by D^. Let 
A := Da o a. Finally, we define a multiplier m on W x ia* by m(s. A) = c(— sA)/c(— A). 
We denote by r the corresponding representation r(s)/(A) = m(s~\ A)/(s^^A). Then, cf. 
[?], Section 1, in particular Lemma 1.4, we have a commutative diagram, where each of the 
maps is an unitary isomorphism: 




(7.5) 



L\A,\W\-'da) 



L^iia* 



' |W||c(A)|: 



Da 



-L\A,\W\-^day^^^ 
L^{ia*,\Wy^dXY^^\ 



Recall the Hardy space H'^{T{Qh)) from Appendix A and its spectral description in The- 
orem EHl It follows then from Theorem 13. 2[ and the obvious renormalization of measures, as 
we have not included the 2tt in the exponential function, that A{H'^{D)^) C H'^ (T {ilH)y^^^ ■ 
As A : |>V|"Ma)^ — > L'^{A, \W\~'^day^^^ is a unitary isomorphism, we get: 

Theorem 7.5. The map A : T-[^(D)^ 7i^(T(f2//))^''^^ is a unitary isomorphism. 

Example 7.6. If G has complex structure, then the map A is a multiplication operator 
given by 



A(/)(a) 



Yl sinh(a,log(a)) /(c 



We now determine the reproducing kernel for 7{^[D)^ . One could easily deduct that from 
Theorem 17.101 but we will give another proof, that follows similar arguments. 

Theorem 7.7. The reproducing kernel IC{z , w) forli?[D)^ is given by 



}C(z, w) 
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Proof. Let / G TH?{D)^ and w e D. Recall, that by Lemma IT^ we have ^{g){\) 
^(A)cosh(A) for all g G n^{D)^. Therefore 

fiw) = {f,K^) 



Thus 

From this we now get: 

K{z, w) 



/(A)cosh(A)fs:^(A)cosh(A) dfiiX) 



1 0-1- 



/(A)ir^(A)cosh(A) 



dX 



f{X)^x{w 



dX 



K^X) 



,c(A)p- 
cosh(A) 



ir^(A)cosh(A)ir,(A)cosh(A) d^{X) 



and the claim follows. 



□ 



Appendix: Hardy spaces on strip domain 

We let V be an Euclidean vector space, e.g. V = M" endowed with the standard inner 
product. Denote by 0(y) the orthogonal group of V and let W C 0(V") be a finite subgroup 
which acts irreducibly on V. We fix Ho & V, yo ^ and set 

fl = int ({convex hull of W(?/o)}) • 

Notice that fl is the interior of a compact polyhedron and that G Write Vc := V®^C ~ 
V + iV for the complexification of V and define a tube domain in Vc by 



T{n) = v + in . 

Let us denote by dx the measure (27r)^'^'™^/^ times the normalized Lebesgue measure on V. 



Then the Fourier transform 



f^Tf{X)= [ fix)e-^''^Ux 
Jv 



is a unitary L^-isomorphism. V* is the dual of V, and {X ■ x) = X{x) denotes the standard 
duality between V and V*. Denote by 0(T{Q)) the space of holomorphic functions on T{Q). 
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The Hardy space 7Y^(T(fi) is defined by: 

n^TiSl)) ■.= {f eOirmWrnli =sup / \ f{x + iy)\^ dx<^} . 

yen Jv 

As the Hardy- norm locally dominates the Bergman-norm on T{Q), it follows hence 7Y^(T(fi)) 
is complete, i.e. a Banach space. In fact, H'^{T{Q)) is a Hilbert space as we will show in a 
moment. Then for / G 1H?{T{VL)) and y G one has 



\f{x + iy)\' dx= [ \mv)m'e-'^''^^ 
Jv* 



which is immediate from 1221 Ch. HI, 52. It follows that 



(7.6) 11/11?, = sup / 

yen Jv* 

For y G V define cosh, coshj^ : ^ C by 

cosh,(A)= 1 5:e-<-^>= 1 

' ' sew ' ' sew 

and 

cosh(A) = coshy^(A) . 
As with II ■ ||l2(v') is W-invariant and J-' is W-equi variant, it follows from ()7.6|) that 

(7.7) ||/f = sup/ |Wk)(Orcosh(y,Orfe. 

yen Jv* 

Now, for every X ^ V, the function y \—>- coshy(A) is strictly convex on Q; hence we have 
the inequality 

(Vy G n){yX G V*) cos^(A) < cosh(A) . 
and so it follows that 

(7.8) 11/11?,= / |Wk)(A)rcosh(A)rfA. 

Jv* 

Define a W-invariant measure fiQ on V* by 

d^o{X) = cosh(A)(iA . 

Theorem 7.8. The mapping 

n\nn))^L\v\d^i,), f^HfW) 

is an isometric isomorphism. In particular, li?{T{VL)) is a Hilbert space. 
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A (continuous) multiplier on V* is a continuous map m : W x — > C such that for all 
s,w E W and A G l^* we have 

■m{sw, A) = m(s, wX)m{w, A) . 

Assume from now on that |m(s, A)| = 1 for all s G W and A G V*. Then, because of the 
W-invariance of dfiQ, we can define a unitary representation of W on L'^iV*, dfj,o) by 

(7.9) Tis)fiX)=mis-\X)fis-'X). 

As the Fourier transform is a unitary isomorphism, we have a unitary representation, also 
denoted by r, of W on ?-^^(T(f2)) such that the Fourier transform is an intertwining operator. 
Denote the space of r(W)-invariant elements by the superscript r(VV). Then 

Corollary 7.9. The Fourier transform is a unitary isomorphism 

T : 7^2(r(r]))-W ^ L\V\ dfioY^"^^ . 

The Hardy space 7i^(T(fi))^'-^^ being a Hilbert space of holomorphic functions admits 
as such a reproducing kernel function K{z, w) often called the Cauchy-Szego-kernel. Notice 
that for fixed w G T{n), the function K,^{z) belongs to n^{T{n)y^^^ and that 

(/, K^) = f{w) for all / G 7^2(T(fi))-W . 

Here of course ( ■ , ■ ) denotes the inner product on 'H'^{T(il)y^'^\ 

We now determine K{z, w) explicitly. For that define for w E V, cos™ : V^* — > C by 

cos-(A) :=^^m(s,A)-V>'^^> 

' ' sew 

and note that 

^ G n\T{Q)y^'^'> 

cosh 

Write (-I-) for the inner product on L\V% dfxoY'-^l For / G n^{T{n)y^^^ let F = J^{f\v)- 
It follows from Corollarv 17.91 that {f,K^) = (F|jF(K"^|y)). On the other hand we have 



f(w) = I F{X)e~'^'"'^^ dX 

^-i{w,\) 

cosh(A) 

/ m{s-\X)F{s-'X) T^TT^dfioiX) 

Jv* cosh(A) 



F(A)m(s"\ sA) — — - dno{X) 

cosn(Aj 



cosh(Aj 
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and thus 

cosn(Aj 

Theorem 7.10. The reproducing kernel for the Hardy space 7i^(T(fi))'^*^^) is given by 



\W\ ^seW m{s,X) J ■ \W\ ^seW m{s,X) 

^'■''^ = ^^^h(A^ 

cos^(A) „ 

.J5ih(A)'=°^-''''''''- 

Example 7.11. The equation ()7.1()j) can be evaluated in the relevant special cases. Let us 
for example consider the case of = M, f2 =] — 1, 1[, W = 0(M) ~ {1, —1} and m(s, A) = 1. 
Using the standard measure on M we get the following from ()7.10|) and 0, Sect. 1.9, formula 
(12): 



K{z, w) 



cos(2;^) cos(w^) 
^ cosh(20 
cosh(|z) ■ cosh(^W) 
2 cosh(f z) + cosh(f w) ' 
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